Biased random walks on complex networks: the role of local navigation rules 
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We study the biased random walk process in random uncorrelated networks with arbitrary degree 
distributions. In our model, the bias is defined by the preferential transition probability, which, in 
recent years, has been commonly used to study efficiency of different routing protocols in commu- 
nication networks. We derive exact expressions for the stationary occupation probability, and for 
the mean transit time between two nodes. The effect of the cyclic search on transit times is also 
explored. Results presented in this paper give the basis for theoretical treatment of the transport- 
related problems on complex networks, including quantitative estimation of the critical value of the 
packet generation rate. 
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The problem of wandering at random in a network (or 
lattice) finds applications in virtually all sciences [H, Q ■ 
With only minor adjustments random walks may repre- 
sent thermal motion of electrons in a metal, or migration 
of holes in a semiconductor. The continuum limit of the 
random walk model is known as diffusion. It may de- 
scribe Brownian motion of a particle immersed in a fluid, 
as well as heat propagation, bacterial motion, and even 
fluctuations in the stock market. Recently, the concept 
of random walks has been also applied to explore traffic 
in complex networks. The spectrum of network related 
problems include, among many others, ordinary traffic 
in a city, distribution of goods and wealth in economies, 
biochemical and gene expression pathways, and finally 
search (or routing) strategies in the Internet and other 
communication networks [3, 0, H, 0, 0, S, 0] ■ 

In this paper, we deal with biased random walks on 
complex networks, and we explore the role of different lo- 
cal navigation rules on the mean first-passage (or transit) 
time between any pair of nodes [10| . The biased random 
walk model defined on scale-free networks is particularly 
interesting since it has been considered as a mechanism 
of transport and search in real networks, including the 
Internet. For a long time one has believed that the most 
optimum transport-related processes are based on short- 
est paths between two nodes under consideration. At the 
moment, one has however understood that such a rout- 
ing strategy would require a global knowledge on network 
topology, which is often not available. Moreover, one can 
simply imagine that routing strategies based on short- 
est paths may create inconvenient queue congestions in 
scale-free networks, given that the majority of the short- 
est paths pass through hub nodes in such structures. It 
has been also realized that a possible alternative is to con- 
sider local navigation rules instead of global knowledge. 
As a consequence, a number of adequate models have 
been proposed (see e.g. [1, S]). In general, the models 
mimic traflSc in complex networks by introducing pack- 
ets (particles) generation rate, as well as assigning a ran- 



domly selected source and a random destination to each 
packet. In these models, a common observation is that 
the traffic exhibits continuous phase transition from free 
fiow to the congested phase as a function of the packet 
generation rate. In the free flow state, the numbers of 
created and delivered particles are balanced, while in the 
jammed state, the number of packets accumulated in the 
network increases with time. In this paper we show that 
the random walk model, although very simple, correctly 
describes properties of the proposed traffic models in the 
free flow state. We calculate transit times characterizing 
this state. We also give some suggestions how to calcu- 
late the critical packet generation rate. 

Technically, we define our random walks as follows. 
We consider random uncorrelated networks with given 
node degree distributions P{k) [11]. The networks are 
also known as random graphs or configuration model, 
and they have been repeatedly shown to be very useful 
in modelling different phenomena taking place on net- 
works. We assume that the networks are connected, i.e. 
there exists a path between each pair of nodes. Given 
the graph structure, the diffusing particle (packet) is cre- 
ated at a randomly selected node, and it is assigned a 
random destination node. In the next time steps the 
particle passes from a node to one of its neighbors being 
directed by local navigation rules. In practice, it means 
that being in a certain node i random walker performs 
a local search in its neighborhood (up to the first, sec- 
ond, or further orders) looking if the destination node is 
within the search area. If the destination is found, the 
particle is delivered directly to the target following the 
shortest path (the rule is known as the cyclic search [1]). 
Otherwise, the particle continues biased random walk, 
i.e. the next position (a node j) is chosen according to 
the prescribed probability Wij . 

In the following, to explore transit times characteriz- 
ing biased random walks in uncorrelated networks with 
arbitrary degree distributions P{k), we partially repro- 
duce and generalize standard calculations for the mean 
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first passage time in periodic lattices [I3 ■ At the begin- 
ning, we work out some general concepts related to biased 
random walks without the cyclic search. In particular, 
we calculate the stationary occupation probability P°° 
for the diffusing particle, which describes the probability 
that the particle is located at the node i in the infinite 
time limit. Then, performing simple textbook calcula- 
tions we derive formulas for the mean transit time be- 
tween any pair of nodes (we would like to stress that some 
time ago similar calculations were done for unbiased ran- 
dom walks on complex networks [l^l; results presented 
in our paper encompass the results of Ref. [l^ as a spe- 
cial case). The role of the cyclic search on transit times 
is explored via a simple renormalization trick applied to 
nodes' degrees. 

Thus, let us consider a particle that hops at discrete 
times between neighboring nodes of a random network 
described by the adjacency matrix A. Let Pij{t) be the 
probability that the particle starting at site i at time t = 
is at site j at time t. The evolution of this occupation 
probability is given by the master equation 
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Ai-jWi-jPii (t). 



(1) 



where the meaning of wij was already exposed, whereas 
Aij represents element of the adjacency matrix, which 
is equal to 1 if there exists a link between I and j, and 
otherwise. In the rest of the paper we perform a de- 
tailed analysis of the local navigation rules defined by the 
preferential transition probability 
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Z^m=l '^m 



(2) 



where the sum in the denominator runs over the neigh- 
bors of the node I, and the exponent a is the model free 
parameter. Note that according to the formula ([2]) the 
transition probability from / to j in our biased random 
walk depends only on the connectivity of the next-step 
node j. Note also that for a = we recover the ordinary 
unbiased random walk studied by Noh and Rieger 
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In order to calculate the stationary occupation proba- 
bility P°° characterizing the studied biased random walks 
we average the master equation ([1} over the ensemble of 
the considered networks (i.e. we apply mean field ap- 
proximation to this equation) 
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Now, before we proceed further, let us recall a few struc- 
tural properties of uncorrelated networks with a given 
node degree distribution. First, one can show that prob- 
ability of a link between any pair of nodes I and j with 



degrees respectively equal to ki and kj is given by (see 
Eq. (27) in [TBI) 



kikj 
{k)N' 



(4) 



Second, since in uncorrelated networks the node degree 
distribution Q{km/ki) of the nearest neighbors of a node 
I does not depend on ki (compare Eq. (1) in li], and 
Eq. (4) in ji3]) 



Q{k„Jki) = 7£^P(fc™), 
(fc) 



(5) 



the normalization factor in the formula ([2]) is equal to 
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and the transition probability wij between I and j aver- 
aged over different network realizations may be written 
as 



(fc) 



(7) 



Finally, inserting the relations ([4]) and ([7]) into the simpli- 
fied master equation after some algebra, one obtains 



P° 



(8) 



Note that for a = 0, which stands for the unbiased ran- 
dom walk, the stationary distribution is, up to normaliza- 
tion, equal to the degree of the the node j, i.e. P°° ~ kj. 
It means that the more links a node has, the more often 
it will be visited by a random walker. Note also that 
for a — ~l, which represents the anti-preferential tran- 
sition probability wij ~ ^/kj, the stationary occupation 
probability is uniform Pj^ = 1/N. 

To test the validity of Eq. ([5]) we have numerically cal- 
culated the fraction of random walkers found in nodes 
with a given connectivity kj. The expected power law 
relation P^ ^ ^^^^ found in all the considered a- 
cases, and for different classes of the analyzed networks 
(i.e. classical random graphs, and scale-free networks 
P{k) ^ k^'' with the characteristic exponent 7 = 3), see 
Fig. [TJ The same scaling behavior was found in Ref. Q 
for the number of packets moving simultaneously on BA 
networks in the free fiow state. In the mentioned pa- 
per, a packet routing strategy based on the preferential 
transition probability ([2]), and the so-called path iteration 
avoidance, which means that no link can be visited twice 
by the same packet, has been considered. At each time 
step R packets have been generated in the network, and 
a fixed node capacity C, that is the number of packets a 
node can forward to other nodes, has been assumed. The 
fact that our results coincide with those of Wang et al. Q 
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FIG. 1: Stationary probability distributions P°°{k) calculated for different values of the parameter a in classical random graphs 
and scale- free networks. Solid lines correspond to the theoretical prediction of Eq. (|8]). All numerical simulations have been 
done for networks of size N = 10'' and averaged over 10* random walkers. In the case of classical random graphs (fc) = 5 was 
assumed, whereas in scale-free networks 7 = 3 and kmin ~ 2 were chosen. 



shows that packets may be considered as non-interacting 
particles (i.e. independent biased random walkers) in the 
free flow, stationary state. One can also show that the 
approach may be used to estimate the critical value of 
packets generation rate Rc [l^ , as the parameter should 
fulfill a kind of balance equation between the node's pro- 
cessing efficiency C, and the number of delivered packets 
delivered P°° Rc{Tij) , where (Tij) stands for the mean 



first-passage time (llSp averaged over all pair of nodes, 
and respectively Rc{Tij) corresponds to the total num- 
ber of packets distributed over the whole network. 

The first-passage probability Fij(t), namely the prob- 
ability that the random walk starting at the node i visits 
j for the first time at time t satisfies the well-known con- 
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volution relation 



(9) 



T = 



The delta function term in the last equation Q ac- 
counts for the initial condition that the walk starts at 
i — j. Applying the Laplace transform, defined as 
/(s) — J2tLo 6 '^'/(i): to this equation leads to the fun- 
damental expression 



(10) 



in which the Laplace transform of the first-passage prob- 
ability Fij{s) is determined by the corresponding trans- 
form of the probability distribution P^j (s) . Consequently, 
due to the fact that all moments 
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of the exponentially decaying part of (t) are finite, 
expanding Pij{s) as a power series in s 
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and then inserting (|12p into (jlO[) . and again expanding 
the result as a series in s, one finally obtains the formula 
for the mean transit time between i and j 



T., = X]i^;,(i) = -<,(0) 



R 



3 
(0) 



for i 
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At the moment, let us remind that P°° ([5]) corresponds 
to the stationary occupation probability, which has been 
already calculated. 

Figure [2] shows how the mean first return time Ta of 
the biased diffusing particle wandering in random net- 
work depends on ki. In the figure, numerically calculated 
transit times are indicated by scattered points, whereas 
their values predicted by the theory (jl3p . namely 



T 



(14) 



are represented by solid lines. Subsets given in the figure 
show how the mean first return time (Ta) averaged over 
all nodes depends on a (i.e. on local navigation rules 
governing the diffusing particle) 



(15) 



and they indirectly show how fast the biased random 
walk is. The minimum value of (Ta) observed for am — 
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FIG. 2: Mean first return time Tu vs node degree ki (main panels), and {Ta) vs a (insets) in classical random graphs and 
scale-free networks. Numerical calculations have been done for networks of size A'' = 10"^. (fc) — 5 and (k) = 2kmm ~ 10 have 
been assumed in classical random graphs and scale-free networks (with 7 = 3), respectively. Data presented in the figure have 
been averaged over 10^ random walkers running in 10^ different network configurations. 




FIG. 3: Mean transit time Tij between two nodes i and j vs connectivity of the target node kj in classical random graphs and 
scale-free networks. Numerical calculations have been done for networks of size A'' = 10*. {k) — 5 and (fc) — 2kmin = 4 have 
been assumed in classical random graphs and scale- free networks (with 7 = 3), respectively. Data presented in the figure have 
been averaged over 10^ random walkers running in 50 different network configurations. 



— 1 in classical random graphs indicates that the anti- 
preferential transition probability ([2]) causes the slowest 
exploration of the considered networks, which, in turn, 
causes that in the case of such a navigation rule the re- 
laxation part of the occupation probability Pa (t) — P°° 
converges to zero much slower then in the case of other 
values of the parameter a (the same reasoning applies to 
the case of ~ —0.5 in scale- free networks). The rea- 
soning implies that although, in general, the parameters 



R^^ and R'l'' in the formula ^ for the mean tran- 
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sit time can not be easily calculated, the expected for 
\a — am I 7^ fast convergence of the occupation probabil- 
ity Pij (t) towards the stationary distribution P^ allows 



one to simplify the relation 
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(16) 



In figure [3] one can see that the theoretical prediction of 
the last equation ()16|) quite good agrees with numerical 
calculations of Tij. As expected, the approximate for- 
mula (|16p works better for the parameter a > am- We 
have also checked that the mean first passage time T^- 
between any pair of nodes does not depend on the source 
node i in the considered networks. It only depends on 
the destination node j. 

Knowing the mean transit time (|13p of the biased ran- 
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dom walk, the role of the cyclic search on the quantity 
can be calculated through simple renormalization trick 
applied to nodes' degrees. The trick consists in divid- 
ing the walk between any pair of nodes i and j into two 
parts. The first part, before the diffusing particle hits 
neighborhood of the target, and the second part, when 
the particle sees its destination, and follows the short- 
est path. Distinguishing between the two parts allows 
to treat the first part as an ordinary biased random walk 
from a node i to the node J with the renormalized degree 
kj equal to 
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where {k'^)/{k) represents the average connectivity of the 
nearest neighbors in uncorrelated networks, and x is the 
parameter describing the depth of the search area. Now, 
since the mean transit time of the second part of the walk 
is equal to x the mean first passage time characterizing 
the whole walk between i and j (i.e. its both parts) is 
given by the sum 



t/;^ =x + Tu^x- 
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and Rfj apply to the 



where the quantities T^j, Pf^ , R 
network, in which the original target node j together with 
its nearest neighborhood was replaced by a single node J 
of degree kj (fT7|) . In this case, however, due to difficul- 
ties related to the precise calculation, or even estimation 
of the parameters and R^ , the direct verification of 
the validity of the formula p8)) is impossible. However, 
we have numerically checked that the mean first passage 
time characterizing the cyclic search does not de- 
pend is the source node z, and in the first approximation 
it is proportional to kj"'^^ (compare Eq. ([16])). 

In summary, we have studied the biased random walk 
process in random uncorrelated networks with arbitrary 
degree distributions. In our model, the bias was defined 
by the preferential transition probability ^ (see also an- 
other paper on biased diffusion in random networks [20|). 
We have calculated the expression for the stationary oc- 
cupation probability, and we have derived formulas for 
the mean first passage times between any pair of nodes. 
The role of the cyclic search on transit times was explored 
via a simple renormalization trick applied to nodes' de- 
grees. We have also shown that the random walk ap- 
proach can be used to explain some properties of traf- 



fic dynamics in communication networks. Other traffic- 
related problems, that can be solved using the approach 
include, among many others, microscopic explanation of 
the phase transition from free flow to the jammed phase, 
and quantitative estimation of the critical value of the 
packet generation rate in scale-free networks Q . We leave 
the problems to our future work [l9| . 
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